Exploratory Behavior, Trap Models and Glass Transitions 
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A random walk is performed on a disordered landscape composed of iV sites randomly and uni- 
formly distributed inside a d- dimensional hypercube. The walker hops from one site to another with 
probability proportional to exp[— /3E(D)], where f3 = 1/T is the inverse of a formal temperature and 
E(D) is an arbitrary cost function which depends on the hop distance D. Analytic results indicate 
that, if E(D) = D d and TV — > oo, there exists a glass transition at /3 d = 7v d/2 /r(d/2 + 1). Below 
Td, the average trapping time diverges and the system falls into an out-of-equilibrium regime with 
aging phenomena. A Levy flight scenario and applications of exploratory behavior are considered. 
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This work focus on a surprising connection between 
two apparently disparated fields: models of exploratory 
behavior P, Q and the statistical physics of glass transi- 
tions described by trap models @, 0, H, Q We show that 
a glass transition may appear when a walker explores 
a random landscape with localized resources. This de- 
pends on a well defined manner of the cost function used 
to weight the possible movements. We have also obtained 
analytical results for finite size effects. This model is a 
simpler version of the stochastic tourist walk 

The stochastic tourist walk can be viewed as a coarse- 
grained description of protein folding dynamics. We rep- 
resent low-lying minima by points in a d-dimcnsional con- 
figuration space. It is known that, in the glass phase, the 
configurational distance between minima constitute the 
dominant "barrier" (instead of energetic barriers) when 
considering coarse grained transitions between minima 
[l5j . Another possible application of our results is in the 
study of charge diffusion over atoms which are random 
impurities in a substrate An exponential decay of 

the transition probability as the configurational distance 
increases is a good approximation in both cases. 

Trap models have been used to handle anomalous dif- 
fusion and a low temperature regime in glass form- 
ing liquids where the system is supposed to hop among 
(free) energy minima |l2l Il3| . In their simplest version 
[4], |5j, each state i = 1, . . . ,N represents a deep mini- 
mum which is endowed with a trap energy Ei ("energy 
model"). When the system escapes from a given state, 
the model assumes that all other states have equal prob- 
ability of being choosen as the next state. Alternatively, 
one can assume barriers Bij between the states i and j 
("barrier model") 0. In such models, at some temper- 
ature T c , there is a transition to an out-of-equilibrium 
regime where the system average trapping time diverges 



and aging phenomena occurs. This kind of scenario has 
been called "weak ergodicity breaking" transition [|| . 

Consider a random walk on a disordered landscape 
composed of N sites (representing, for example, localized 
feeding sites as flowers, trees, water holes, islands etc.). 
The coordinates of these sites are random and uniformly 
distributed along the unitary sides of d-dimensional hy- 
percube. To perform a transition to another site, the 
walker uses a strategy based in some arbitrary cost func- 
tion E(Dij) which depends on the distance between 
sites i and j. Thus, E(Dij) is similar to a barrier in 
trap models. In our model the random variable is Dij 
with the probability distribution function (PDF) P(Dij) 
fixed by the landscape. This contrasts to usual trap mod- 
els, where E is the random variable with P(E) given 
by experimental evidences. Examples of the latter are 
Gumbel (exponential) distribution for extreme minima 
[lij and Gaussian PDF for super cooled liquids [l^. A 
further contrast is that one has freedom to choose the 
cost function E(Dij). Depending on its functional form, 
several scenarios can be envisaged for the decay of transi- 
tion probabilities with distance, for example exponential, 
Gaussian, power law etc. For each value of spatial di- 
mension d, we have found the specific cost function that 
creates a glass transition which separates two distinct 
exploratory behaviors. 

The glass transition is characterized by a diverging 
mean residence time leading to out-of-equilibrium behav- 
ior. We have found analytically that the critical point is 
related to geometrical aspects of the distribution of sites 
and occurs at (3 d = l/T d = n d / 2 /T(d/2 + 1), which is the 
volume of a d-dimensional hypersphere of unitary radius 
and r(d/2 + 1) is the gamma function. Monte Carlo ex- 
periments validate the analytical analysis. We also show 
that the finite size and finite sample effects depend loga- 
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rithmically on the number of sites and samples. 

Consider a Poisson landscape where special ( "feeding" ) 

(k) 

sites have coordinates x\ , with i = 1,2,..., TV and 
k = 1, 2, . . . , d, that are uniform and randomly chosen in 
the interval [0,1]. A normalized Euclidean distance be- 
tween sites i and j: D. tJ = iW«*{^ =i [ x ( fe )_ a; ( fc )]2}.i/2 is 
introduced to simulate a constant density of points since 
the mean site separation is proportional to N~ x / d . The 
walker goes from site i to any other site j, at each time 
step, with a "thermal" activation probability: 
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with Z i (P) = Y, e ~ mDii) > (!) 



3 = 1 



where (3 is an external parameter which is the inverse of a 
formal temperature. The cost function E(Dij) depends 
on the normalized distance Dij such that E(Du) = 
allowing the walker remain in the site i. Clearly, if (3 — > 
oo, the walker remains in the present site (Wu = 1). On 
the other hand, if (3 — ► 0, the walker goes equally to any 
other site, regardless the distance. 

Next we want to show that, although any site has a 
finite trapping time, the average residence time (t r ) di- 
verges below a finite stochasticity level Td- In this case, 
the system falls into a out-of-equilibrium regime and ag- 
ing phenomena appears. 

Consider discrete time steps. The probability of a 
walker to remain in a given site a is p a (/3) = W a -*a = 
1/Z a and the probability that the walker leaves site 
a is q a {0) = 1 — Pa{(3)- Calculations become eas- 
ier if the distances are relabeled according to the or- 
dering with respect site a, so that the nearest neigh- 
bor of site a is at D[ a \ the second nearest neighbor 
is at £>2 an d so forth. One may write Z a {j3) = 
1 + exp[-/3£(Z^ a) )]£f = Vexp[-/3A( a) ] with: A< a) - 
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E{D^ a) )^E(D[ a) ). 

Given that at t = 0, the walker is at site a, the 
probability the walker remains there till time t and 
leaves this site at t + 1 is given by the geometric dis- 
tribution (the first failure after t successes): Pp{t) = 
p a ((3)q a ((3). The residence (trapping) time associated 
to site a is defined as the expected time: tr {(3) = 
Et^o* Pl(P)laW = ~ Pa(P)], which reads: 

t^iP) = exp[PE(D[ a) )]/{l + Ef^ 1 exp[-/?A< a) ]}. 

The mean residence time for one realization of site dis- 
tribution is: t r (/3) = E^Li ^ {(3)/N and the average 
over the disorder leads to: 
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dDi...dDjv_i 



,/3B(Di) 



P(D 1 ,...,D N _ 1 )t 1 (/3) 



(2) 



To calculate the average of this trapping time over 
all possible sites, one needs to average over the full 



probability density distribution of neighbor distances 
P(D\, . . . ,-D,/v_i). This is a difficult task once it takes 
the boundaries into account. To remove the dependence 
on the boundaries one takes the thcrmodynamical limit 
N — > oo. Since the set of distances is an ordered set 
D\ < D<z < . . . < Djv, the interdependence of the vari- 
ables does not allow the factorization of the joint prob- 
ability. One can make an approximation by considering 
the effect on the trapping time of the transitions to the 
first neighbor (Aj — ► oo). Considering Aa?_i > . . . A 2 > 
E(Di), one can consider Y^j=2 ex P[ — fl^j] <C 1 and ne- 
glect this summation, which can also be viewed as a f3 
(high temperature) expansion. In this approximation one 
considers only the nearest neighbor distance PDF P{D\) 
leading to (t r ((3)) = (ti(/3)) where: 



(h{P)) = / dDiP(Di)e 



(3) 



Considering bounds on the influence of the next neigh- 
bors it is possible to show that diverges, with the 
same exponent, at the same (3 as the exact t r (/3) as it be 
shown. 

For a spatial Poisson process, one can easily show 
that P(D{) = cxp[-V r d (£ii)]dV/ d ( J Di)/dD 1 , where 
Vd(R) = Ad R d is the volume of a hypersphere of ra- 
dius R and the geometrical factor (the volume of an 
unitary radius hypersphere) is Ad = ir d / 2 /T{d/2 + 1), 
with T(z) being the gamma function. Then: P{D\) = 
AddDf^e-^ ^ and 



(t 1 ((3))=A d d / d^^- 1 
Jo 



o [0E(D 1 )-A d Di] 



(4) 



Firstly, consider a cost function family which depends 
on a power of the distance, E(Dij) — D°j, where a is 
an adjustable exponent. For a < d the above integral is 
finite for any (3 value, so that, for long times, the system 
presents usual diffusive behavior. Conversely, for a > d, 
the above integral is always divergent and the system is 
in an out-of-equilibrium regime. However, for a = d, 
the residence time and the tail of the distance distri- 
bution compete and a glass transition appears at finite 
value of p: (h({3)) = A d d / °° dDxDf' 1 e -Df(^-« = 
Adj^dxe-^-^: 



(HP)} 



A d /{A d ~f3) {f3<A d ) 
oo {13 > A d ) 



(5) 



The mean residence time is finite only for [3 < Ad and it 
diverges at: 



(3d = A d 



T d/2 



r(d/2 + i) 



(6) 



which is just the volume of an unitary radius hypersphere 
in d dimensions. For example, f3\ — 2, (32 — 7r, /?3 = 47r / 3 
etc. The value of (3\ has been also found in Ref. jlOj . 
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where the walker is not allowed to remain at the same 
site. 

The residence time divergence at (3 d occurs only in the 
limit N — > oo and it is difficult to be observed in numer- 
ical experiments. Thus, finite size effects are important 
and they can be taken into account considering a cutoff 
value D C (N): (h) = A d d J ° c dD, D d ~ X e D ^~^\ 
and Eq. (J2J) becomes: 



A d -(3 



1 



(7) 



Notice that at j3 = (3d, the mean residence time is the 
volume of the largest hypersphere found in the N r real- 
izations: (ti> = V d {D c ) = A d D d c . 

The value of D c can be estimated from extremal statis- 
tics concepts, being the most probable value of the Gum- 
bel distribution [19j . Consider a Monte Carlo calcula- 
tion of Eq. © where the average is taken over M land- 
scapes with N points, i.e., N r = MN distances D\ are 
sampled. The cut-off D c is obtained from the condition 
N r /~ AD x P{Di) = 1 which reads N r exp[-V d (D c )] = 1 
or D c = [\nN r /A d ] 1 / d . For d=l, one has D c = ln(iV r )/2 
and for d = 2, D c = ^n(N r ) /it] 1 / 2 . In Fig. ^ we compare 
Eq. (JJJ with results from Monte Carlo calculations for 
(ti) and for the full residence time (t r ). Here we stress 
that in (t r ) the normalization Z\ is calculated with all 
the terms exp[— (3E{Dk)}- Notice that, for f3 — 0, we 
have (ti) = 1 and (t r ) = 1/(N — 1) but the two curves 
grows in the same way for larger (3. 

One can find the residence time PDF Pr{t\) at tem- 
perature T, in the first neighbor approximation. Chang- 
ing variables D t = (T\nt 1 ) 1 / d [sec Eq. ©] in P T (h) = 
P[i5i(ti)]dDi/dii leads to P T (h) = A d T t7 {1+AdT \ 
which has a power law tail t^ 1 with exponent 7 = 
1 + A d T. As it is well known, the first moment diverges 
when the exponent is bellow 7 C = 2, that is, T d = l/A d . 

For d = 2 the distance distribution function P(D{) = 
■kD\ exp(—irD 2 ) presents a Gaussian tail. In this case, a 
well-defined glass transition appears when the cost func- 
tion takes the form E(Djj) = D\y Notice that no glass 
transition occurs when E(Dij) = Dij, although very long 
residence times exist when (3 — > 00. This case E(Dij) = 
Dij is mathematically equivalent to Bouchaud's trap 
model for barrier distribution with Gaussian tail (with 
notation Bij = Dij). Thus, no glass transition is present 
at finite T in the latter case [l?]]. To have a glass tran- 
sition at finite T, the hopping probability in a Gaus- 
sian Bouchaud's trap model should have a Gaussian form 
Wi^j cx exp(-0B*). 

Now we consider an improved calculation for the mean 
residence time (t r ((3)) when E(D) = ND d . The approx- 
imation consists to replace the distances to their mean 
values [2(1 HH in the denominator of Eq. |21 Dj = (Dj) = 
(A d N)-V d T(j +_Ud)/T{j) = \j/(NAd)}V d , where the 
approximation [20|: T(j + \/d)/T{j) = j 1 ^ has been 
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FIG. 1: (a) Monte Carlo calculations of (ti) for d = 1 (A) 
and d = 2 (□) and (t r ) (A, ■) which are compared to the 
curves Eqs. I|7I8|I (solid) as a function of j3. Used values are: 
iV = 100 (with periodic boundary conditions for measuring 
distances), M = 10 4 (that is, iV r = 10 6 ) leading to D c w 6.91 
for d = 1 and D c m 2.10 for d — 2. (b) The same as before 
but on a log-log scale. Inset: Histogram of sampled values 
of Di for d = 2 compared to D c = [ln(N r ) /tt] 1/2 . 



employed. In this way we obtain: 



(tr((3)) = 



1 _ e -0/A d 
1 _ e -(N-l)p/A d 



<*iG3)> , 



(8) 



where (ti(/3)} is given by Eq. As it can be seen 

in Fig. ^this curve is in very good agreement with the 
Monte Carlo calculation. 

The specific distribution P(Di) = cxp[— V d (Di)] stud- 
ied here arises from the particular distribution of sites 
used (Poisson process), nevertheless other scenarios can 
be envisaged. Consider, for example, a distribution of 
points where the distance PDF has a power law tail, 
P(Di) oc D^ b (Levy process) HHHIj. For any cost 
function of the form E = D°j the walker is always in 
the glass regime. In the integral of Eq. ©, P(D\) can- 
not compete with an exponentially increasing residence 
times exp((3D" ). However, if the walker now uses a cost 
function of the form E(Dij) = \n(l + D^), both the tran- 
sition probability and the residence time have power law 
forms, Wi^j = (1 + DiA-P/Zi and t x = (1 + Lq)' 3 , re- 
spectively. In this case, the average residence time is: 
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(ii(/3)} oc j dDi D)^ ^ and a glass transition occurs at 
0d = b-l. 

In a destructive foraging scenario [lj a walker wants 
to find unvisitcd feeding sites. One can naively think 
that the walker should avoid glass transitions to reduce 
trapping times by choosing a < d. Such values of a 
produce long hoppings which favor transitions to unvis- 
ited sites (the limit a — > 0, /3 — > oo such that a/3 = cte 
produces Levy flights). Nevertheless this procedure also 
increases the total traveling cost. We conjecture that the 
efficiency of this kind of exploration is maximized when 
the cost function allows a glass transition, for instance 
E{D) = D d in the Poisson case. Then, the optimal ex- 
ploratory process may occur at some temperature above 
the glass temperature T4. This will be fully discussed 
elsewhere. 

Finally, we compare the present to previous models 
of exploratory behavior. If one prohibits the walker to 
remain at the same site (W a -^a = 0) the fundamental 
traps are cycles of period two instead of single sites. Also 
in this case we have found similar glass transitions [Ioj| . 
If one prohibits the walker to go to sites within a self- 
avoiding window of the t past visited sites, the traps are 
cycles of diverse periods 0, H, E| ■ In the latter case we 
also expect that the escaping from cycles is done through 
a glass transition which is a theme for a future study. 

In conclusion, we have introduced a simple exploratory 
behavior model where the hop probability between feed- 
ing sites depends on the site distances and a formal tem- 
perature that controls the stochasticity level. We have 
presented a simple analytical treatment that predicts the 
existence of a glass transition. This transition depends on 
the competition between the walker cost function and the 
geometry of first neighbor distances. Our model brings 
glass transitions previously found in usual trap models 
to a very simple geometrical context. The approxima- 
tions used give insight on the transition mechanism and 
accords well with results from numerical experiments. 
Finite size effects depend logarithmically on the num- 
ber of sites and sample for large N and M. The mean 
neighbor distance approximation on the calculation of 
the mean residence time extends the trap model approx- 
imation where only the first neighbor is considered. 
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